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Image Processing Apparatus, Image Processing Method, and 
Image Processing Program Storage Medium 

BACKGROUND OF THE INVENTION 
5 i) Field of the Invention 

The present invention relates to an image processing 
apparatus and an image processing method for subjecting a 
medical image represented by digital data in a medical field 
to an image processing, and an image processing program 
GjfO storage medium in which an image processing program for 

operating a computer system as such image processing 
4* apparatus is stored. 

Ci ii) Description of Related Art 

a With a medical progress and a rapid progress of an 

\JL5 information processing technique, digitization of a medical 
\l image has been advanced, social basis has been prepared and 

pi importance of medical image diagnosis has increased. Reading 

of a simple radiograph (image diagnosis) has heretofore been 
performed by a method of outputting an image to a film and 
20 diagnosing the image. In this method, diagnosis expenses 
(direct expenses of a film, film bag, and the like and 
managing/working expenses) associated with film operation are 
required, output of a plurality of films is sometimes needed 
in accordance with an image diagnosis purpose, and 
25 considerable cost -up problems such as a diagnosis expense 
increase and diagnosis time increase arise. 

From now on, it is expected that it is essential in 
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future to use a CRT monitor on a computer, observe an image 
and read the image (diagnose the image). In this case, an 
image quality level equivalent to or higher than that of the 
film is required. 
5 When a chest image or another simple radiograph is 

displayed as it is by the CRT monitor, digital data of the 
simple radiograph output ted from a computed radiography (CR) 
photography device is original image data dependent on the 
device, or image data having no contrast and being unsuitable 
C|o for medical image diagnosis. Additionally, the CR 
"M photography device itself is constituted in consideration of 

*K a film property, and a problem occurs that the image data is 

m 

to not formed by considering any CRT monitor. 

- Therefore, it is proposed to perform an image 

processing in such a manner that an image suitable for 
!y diagnosis is executed and to display the image subjected to 

PI the image processing for diagnosis instead of displaying the 

image as it is on the CRT monitor. 

Additionally, to handle various medical images , an 
20 image processing condition is adjusted in such a manner that 
a satisfactory image can be obtained for a certain medical 
image (e.g., a chest simple radiograph), but an image 
unsuitable for diagnosis is obtained for another medical 
image (e.g., mammography), and there is a problem that it is 
25 remarkably difficult to set an image processing condition. 

Moreover, even with a medical image photography 
device of the same device type, the setting condition for 
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photography of the medical image photography device differs 
with a hospital in which the medical image photography device 
is installed, or there is a difference in a hospital doctor's 
liking and experience in observation, and in this case it is 
5 a problem to provide individual hospitals or individual users 
with the medical image easy to observe. 

Furthermore, for example, it is also a problem to 
present an area of interest as an image easy to see, or to 
present an image suitable for observation of symmetry when 
? *i0 the symmetry of a human body is to be observed. 

£ SUMMARY OF THE INVENTION 

* The present invention has been developed in 

f consideration of the aforementioned circumstances, and an 

Ml 5 object thereof is to provide an image processing apparatus 
: %l and an image processing method by which a processing suitable 

3 for observation can be performed with respect to various 

medical images, and an image processing program storage 
medium in which an image processing program for operating a 
20 computer system as the image processing apparatus is stored. 
To achieve the aforementioned object according to 
the present invention there is provided an image processing 
apparatus for subjecting a medical image to an image 
processing , comprising : 
25 an image processing condition storing section for 

storing an image processing condition when the medical image 
is subjected to the image processing in accordance with a 
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photography device type and a photography condition when the 
medical image is obtained; 

a data obtaining section for obtaining the medical 
image, and the photography device type and the photography 
5 condition when the medical image is obtained; and 

an image processing section for reading the image 
processing condition for the same photography device type and 
photography condition as the photography device type and 
photography condition obtained by the data obtaining section 
OO from the image processing condition storing section, and 
HI subjecting the medical image obtained by the data obtaining 

J; section to the image processing in accordance with the read 

M image processing condition, 

\" For the image processing apparatus of the present 

lJ.5 invention, when the image processing condition is stored 
n beforehand in accordance with the photography device type and 

J:;f photography condition for obtaining the medical image as 

described above, and the medical image is subjected to the 
image processing, the image processing is performed in 
20 accordance with the image processing condition adapted to the 
medical image, various medical images are subjected to 
respective appropriate image processings, and an image 
suitable for diagnosis can be obtained with respect to any 
medical image . 

25 Here, in the image processing apparatus of the 

present invention, the image processing section subjects the 
medical image obtained by the data processing section to at 
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least a gradation conversion processing and a frequency 

emphasis processing, and 

the image processing condition storing section 

preferably stores a frequency emphasis function indicating a 
5 degree of frequency emphasis in which a gradation conversion 

function and an average density around respective points -of 

the medical image are used as variables in accordance with 

the photography device type and the photography condition. 

When a gradation processing is performed using the 
130 gradation conversion function in accordance with the 
%i photography device type and photography condition, and a 

4* frequency emphasis processing is performed using the 

:|! frequency emphasis function indicating the degree of 

frequency emphasis with the densities of the respective 
Lj.5 points of the medical image used as the variables, the image 
^1 suitable for diagnosis can be obtained. 

25 Furthermore, in the image processing apparatus of 

the present invention, before the gradation conversion 
processing, the image processing section preferably subjects 
20 the medical image obtained by the data obtaining section to a 
luminance correction processing using a dynamic range 
compression function in which the average density around the 
respective points of the medical image is used as the 
variable . 

25 For example, when a chest image or another image 

provided with a broad diagnosis visible area is compared with 
an image recorded on a film in image quality, without 



performing the luminance correction processing, by 
emphasizing contrast (enlarging a dynamic range) to enhance a 
diagnosis performance, a low density portion changes to be 
white, a high density portion changes to be black, 
information disappears , an area able to be diagnosed is 
narrowed, and an image suitable for the object cannot be~ 
formed in some cases. 

In this case, when the luminance correction 
processing is performed as described above, the dynamic range 
as the entire image is compressed to preserve density 
graduation. Additionally, since a fine structure on the 
image is kept by the luminance correction processing, as 
compared with a simple luminance correction processing, the 
image more suitable for the diagnosis purpose can be obtained 
by the subsequent image processing. 

Moreover, the image processing apparatus of the 
present invention is preferably provided with an image 
processing condition operating section for adding, changing, 
and deleting the image processing condition in response to an 
operation. 

By providing the image processing condition 
operating section, the image processing condition can be 
adjusted, for example, for each image processing apparatus, 
or for each user which uses the image processing apparatus 
even with one image processing apparatus, and the image 
provided with a satisfactory observation performance can be 
obtained in accordance with an environment in which the image 
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processing apparatus is installed, user's liking, and the 
like . 

Moreover, for the image processing apparatus of the 
present invention, the medical image subjected to the image 
5 processing may be transferred to another apparatus, but the 

image processing apparatus itself of the present invention is 
preferably provided with an image display section for 
displaying the medical image subjected to the image 
processing by the image processing section. 
IfiO Here, the apparatus is preferably provided with an 

SI interested area designating section for designating a desired 

,C area of interest on the medical image displayed in the image 

Igl display section in response to the operation, and the image 

-V* display section lowers a luminance of an area excluding the 

Ll5 area of interest designated by the interested area 
G designating section to display the medical image. 

Moreover, in this case, the interested area 
designating section preferably designates the desired area of 
interest on the medical image displayed in the image display 
20 section and designates a coefficient indicating a degree of 
drop of the luminance of the area excluding the area of 
interest in response to the operation, and the image display 
section lowers the luminance of the area excluding the area 
of interest designated by the interested area designating 
25 section down to the luminance in accordance with the 

coefficient designated by the interested area designating 
section to display the medical image. 
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When the area of interest is designated on the 
medical image , by lowering the luminance of the area except 
the area of interest on the medical image and displaying the 
medical image, there is provided a medical image easy to 
5 observe with respect to the area of interest. In this case, 
when the luminance of the area except the area of interest 
can arbitrarily be adjusted, a position of the area of 
interest in the entire medical image can be confirmed in 
accordance with the user's liking, and adjustment can be 

jj!p performed in such a manner that the area of interest can be 

■%l observed in a concentrated manner. 

s j; Moreover, when the image processing apparatus of the 

4} present invention is provided with the interested area 

designating section, the apparatus is further provided with a 
ijs part recognizing section for recognizing positions of a 
l„\ plurality of parts appearing in one medical image, and the 

image processing section preferably subjects the area of 
interest designated by the interested area designating 
section to the image processing for the part appearing on the 
20 area of interest among the parts recognized by the part 
recognizing section . 

In this case, when an observer designates the area 
of interest, the observer does not have to designate the 
image processing condition in accordance with the area of 
25 interest, the image processing is performed on the image 
processing condition suitable for the designated area of 
interest, and operability is enhanced. 



Moreover, when the image processing apparatus of the 
present invention is provided with the interested area 
designating section, the image display section arranges and 
displays a plurality of medical images, applies the same area 
of interest as the area of interest designated by the 
interested area designating section with respect to one - 
medical image among the plurality of medical images displayed 
on the image display section to the plurality of medical 
images, and lowers the luminance of the area except the area 
of interest of each medical image to display the plurality of 
medical images . 

By setting and displaying the same area of interest 
in the plurality of medical images in this manner, it becomes 
easy to compare and examine, for example, a past case with a 
current symptom with respect to the area of interest. 

Furthermore, when the image processing apparatus of 
the present invention is provided with the image display 
section, the apparatus is provided with a scanning processing 
designating section for designating a scanning processing of 
setting the area of interest on the medical image displayed 
in the image display section and moving the area of interest 
in a predetermined direction in response to the operation, 
and 

the image display section preferably displays the 
medical image in which the area of interest successively 
moves , and the luminance of the area except the area of 
interest is lowered in response to designation of the 
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scanning processing by the scanning processing designating 
section . 

Moreover, in this case, the apparatus is provided 
with the part recognizing section for recognizing the 
5 positions of the plurality of parts appearing in one medical 
image, and the image processing section preferably subjects 
the successively moving area of interest to the image 
processing in accordance with the part appearing in the 
successively moving area of interest among the parts 
I3J0 recognized by the part recognizing section. 
SI In this case, the image processing condition does 

4« not have to be designated, and in response to the movement of 

s|J the area of interest the moved area of interest is displayed 

in an easily observed mode* 
pL5 Furthermore, when the image processing apparatus of 

Lj the present invention is provided with the scanning 

3f processing designating section, for the image display section, 

in response to the designation of the scanning processing by 
the scanning processing designating section, the same area of 
20 interest is set in the same position at the same timing and 

the plurality of medical images in which the area of interest 
moves synchronously at the same speed are preferably arranged 
and displayed . 

In this case, the symmetry of the human body can be 
25 observed, for example, in comparison with a past image. 

Moreover, in the image processing apparatus of the 
present invention, the data obtaining section typically 
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obtains a radiation image as one type of the medical image. 

When the image processing apparatus of the present 
invention is specified as an apparatus for handling the 
radiation image, there is provided an image processing 
5 apparatus for subjecting the radiation image to an image 
processing, comprising: 

an image processing condition storing section for 
storing an image processing condition when the radiation 
image is subjected to the image processing in accordance with 
I3|0 a photography device type and photography part when the 

•SSI? 

S| radiation image is obtained; 

F |: a data obtaining section for obtaining the radio 

III image, and the photography device type and photography part 

s 7" when the radiation image is obtained; and 

lj.5 an image processing section for reading the image 

f]' processing condition for the same photography device type and 

"a 

photography part as the photography device type and 

photography part obtained by the data obtaining section from 

the image processing condition storing section, and 
20 subjecting the radiation image obtained by the data obtaining 

section to the image processing in accordance with the read 

image processing condition. 

Moreover, in order to achieve the aforementioned 

object according to the present invention there is provided 
25 an image processing method for subjecting a medical image to 

an image processing, comprising steps of: 

storing an image processing condition when the 
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medical image is subjected to the image processing in 
accordance with a photography device type and a photography 
condition when the medical image is obtained; and 

obtaining the medical image, and the photography 
5 device type and the photography condition when the medical 

image is obtained, and subjecting the obtained medical image 
to the image processing in accordance with the image 
processing condition for the same photography device type and 
photography condition as the obtained photography device type 
H|0 and photography condition. 

HJ The image processing method of the present invention 

4 |! is a method realized by the image processing apparatus of the 

Hi 

k f% present invention, and includes modes corresponding to all 

[*' modes of the image processing apparatus of the present 

jJis invention. 

n Furthermore, in order to achieve the aforementioned 

Jrf object according to the present invention there is provided 

with an image processing program storage medium in which an 
image processing program for operating a computer system as 
20 an image processing apparatus for subjecting a medical image 
to an image processing is stored, the stored image processing 
program comprising: 

a data obtaining section for obtaining the medical 
image, and a photography device type and a photography 
25 condition when the medical image is obtained; and 

an image processing section for subjecting the 
medical image obtained by the data obtaining section to the 
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image processing in accordance with an image processing 
condition for the same photography device type and 
photography condition as the photography device type and 
photography condition obtained by the data obtaining section. 
5 For the image processing program storage medium of 

the present invention, when the stored image processing ~ 
program is executed by the computer system, the computer 
system is operated as the image processing apparatus of the 
present invention, and modes corresponding to all modes of 

ftp the image processing apparatus of the present invention are 

%l included. 

J?} BRIEF DESCRIPTION OF THE DRAWINGS 

^ Fig. 1 is an appearance perspective view of a 

Q.5 personal computer. 

H Fig. 2 is a hardware constitution view of the 

lZl personal computer. 

Fig. 3 is a function block diagram of a first 
embodiment of an image processing apparatus of the present 
20 invention. 

Fig. 4 is a detailed block diagram of an image 
processing section of the image processing apparatus shown in 
Fig. 3. 

Fig. 5 is a schematic view showing one embodiment of 
25 a storage medium of the present invention. 

Figs . 6A and 6B are explanatory views of a principle 
of a luminance correction processing. 
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Fig. 7 is a flowchart of a luminance correction 
processing program. 

Fig. 8 is a graph showing a luminance correction 
processing curve. 
5 Fig. 9 is a flowchart showing a convolution 

processing routine. 

Fig. 10 is a flowchart of a gradation processing 

program. 

Fig. 11 is a graph showing a correspondence between 
CD a pixel value of an original image and the pixel value of a 
SI gradation conversion image. 

41 Fig. 12 is a flowchart showing a non- linear 

ffl conversion curve data preparation processing. 

Fig. 13 is a chart showing a frequency coefficient 
lJ-5 showing a degree of frequency emphasis with respect to the 
v„j pixel value of the original image. 

2 Fig. 14 is a flowchart of a frequency processing 

program. 

Fig. 15 is a flowchart of a histogram analysis and 
20 window processing program. 

Fig. 16 is a chart showing one example of a 
processing effect by the present embodiment. 

Fig. 17 is a flowchart showing an initial image 
display and showing registration and re-use of an image 
25 quality parameter for defining an image processing condition. 

Fig. 18 is a diagram showing one example of the 
initial display image. 



l!0!L13tt--JL-i]JI!L!iJEmUiiUUJLi Ji li imjuaij jil, 



- 15 - 

Fig. 19 is a diagram showing an image quality 
adjustment dialog box (gradation processing) . 

Fig. 20 is a diagram showing the image quality 
adjustment dialog box (luminance correction processing). 
5 Fig. 21 is a diagram showing the image quality 

adjustment dialog box (frequency processing) . 

Fig. 22 is a diagram showing the image quality 
adjustment dialog box (basic processing). 

Fig. 23 is a diagram showing a masking dialog box. 
fcp Fig. 24 is a diagram showing one example of a 

SI medical image subjected to a masking processing. 
V; Fig. 25 is a diagram showing that two medical images 

lf% are arranged and displayed. 

Fig. 2 6 is a flowchart of the masking processing. 
15 Fig. 27 is a diagram showing a scanning dialog box. 

l\ Fig. 28 is a diagram showing the medical image 

*;? subjected to a scanning processing. 

Fig. 29 is a flowchart of the scanning processing. 
Fig. 30 is a flowchart of an automatic part 
20 recognition processing. 

Fig. 31 is an explanatory view of a map data 
preparation processing procedure. 

Fig. 32 is an explanatory view of the map data 
preparation processing procedure. 
25 Fig. 33 is an explanatory view of the map data 

preparation processing procedure . 

Fig. 34 is an explanatory view of the map data 
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preparation processing procedure. 

Fig. 35 is an explanatory view of the map data 
preparation processing procedure. 

Fig. 36 is an explanatory view of the map data 
5 preparation processing procedure. 

Fig. 37 is an explanatory view of the map data 
preparation processing procedure. 

Fig. 38 is an explanatory view of the map data 
preparation processing procedure. 

j|p Fig. 39 is an explanatory view of the map data 

* 0 

SI preparation processing procedure. 

j! Fig. 40 is an explanatory view of the map data 

hi 

J3 preparation processing procedure. 

I" Fig. 41 is an explanatory view of the map data 

iJL5 preparation processing procedure. 

n Fig. 42 is an explanatory view of the map data 

5f preparation processing procedure. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
20 An embodiment of the present invention will be 

described hereinafter. 

Here, the embodiment constituted by mounting an 
image processing program on a personal computer and operated 
as an image processing apparatus of the present invention 
25 will be described. Therefore, first the personal computer 
itself will be described, and a processing content executed 
by the personal computer will next be described. 
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Fig. 1 is an appearance perspective view of the 
personal computer, and Fig. 2 is a hardware constitution view 
of the personal computer. 

For an appearance constitution, a personal computer 
5 100 is provided with: a main body apparatus 110; an image 

display 120 for displaying an image on a display screen 121 
in response to an instruction from the main body apparatus 
110; a keyboard 130 for inputting various information to the 
main body apparatus 110 in response to key operation; and a 
IjjO mouse 140 for designating an arbitrary position on the 
%| display screen 121 to input the instruction, for example, 

s |; corresponding to an icon displayed in the position. In 

~g appearance, the main body apparatus 110 is provided with a 

I" floppy disk mounting port 110a for mounting a floppy disk, 

I 15 and a CD-ROM mounting port 110b for mounting a CD-ROM. 

As shown in Fig. 2, the main body apparatus 110 
;2f contains therein: a CPU 111 for executing various programs; a 

main memory 112 for developing the program to be executed by 
the CPU 111; a hard disk drive 113 in which various programs 
20 and data are stored; an FD drive 114, on which a floppy disk 
10 is mounted, for accessing the mounted floppy disk 10; a 
CD-ROM drive 115, on which a CD-ROM 11 is mounted, for 
accessing the mounted CD-ROM 11; an input interface 116, 
connected to a scanner for reading the medical image obtained 
25 on a medical image obtaining photography device or a film to 
obtain digital data represented by the medical image, for 
receiving the medical image as the digital data; and an 
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output interface 117 for transmitting the medical image 
subjected to an image processing to the outside, and these 
various devices are connected to the image display 120, 
keyboard 130 and mouse 140 also shown in Fig. 1 via a bus 150 

Fig. 3 is a function block diagram of a first 
embodiment of the image processing apparatus of the present 
invention. 

An image processing apparatus 200 shown in Fig. 3 is 
constituted of the personal computer shown in Figs. 1 and 2, 
data stored in the personal computer and the program operated 
by the personal computer. 

To a data obtaining section 211 of the image 
processing apparatus shown in Fig. 3, medical images such as 
a radiation image, and a photography device type and 
photography condition when the medical image is obtained, 
represented by digital data, are inputted, and the data 
obtaining section 211 generates an object constituted by 
combining the inputted medical image, photography device type 
and photography condition ♦ 

On hardware, the data obtaining section 211 is 
constituted of the input interface 116 shown in Fig. 2, the 
hard disk drive 113 and main memory 112 for storing the 
program to generate the object, the CPU 111 for executing the 
program, and the like. The medical image, photography device 
type and photography condition inputted to the data obtaining 
section 211 and combined and generated as the object are 
inputted to an image processing section 212, and the image 
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processing section 212 subjects the medical image to the 

image processing. 

In an image processing condition storing section 218, 

as partially illustrated in tables 1 to 3 , the photography 
5 device type and photography condition and an image processing 

condition are correlated with one another and stored. 

Moreover, in the image processing condition storing 

section 218, in response to the photography device types and 

photography conditions, and even with one photography device 
fjp type and one photography condition, the image processing 
%l condition for respective parts (e.g., a lung field, 
; p mediastinum, rib, heart, diaphragm, and the like) in a chest 
ill simple X-ray image) appearing in the medical image 

photographed by the photography device type and on the 
5l 5 photography condition is also stored. 

r« Furthermore, these image processing conditions can 

!jf be customized for each user (e.g., each doctor or each 

inspecting engineer) . When the customizing is performed, the 
image processing condition for each user is stored in the 

20 image processing condition storing section 218. 

In order to subject the medical image in the object 
sent from the data obtaining section 211 to the image 
processing, the image processing condition for the same 
photography device type and photography condition as the 

25 photography device type and photography condition in the 

object is read, and the image processing section 212 performs 
the image processing in accordance with the image processing 
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condition read from the image processing condition storing 
section 218. In connection to the hardware, the image 
processing section 212 corresponds to the hard disk drive 113 
and main memory 112, shown in Fig. 2, for storing the image 
processing program, and the CPU 111 for executing the image 
processing program,, and on the hardware, the image processing 
condition storing section 218 corresponds to the hard disk 
drive 113 for storing a table prepared by combining the 
photography condition with the image processing condition as 
illustrated in the tables 1 to 3. 

Additionally, here, the medical image before 
subjected to the image processing in the image processing 
section 212 will be referred to as an input image, and the 
medical image after subjected to the image processing will be 
referred to as an output image . 

Contents of the tables 1 to 3 will be described 

below. 
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Table 1 



Photography device 
type 


Device ABC 


~J~ TTl /T^i T^/^h f~°* A G C! "1 T"* fT f~\ n /"I t +■ -T t™1 

X llLCty t> i-Z-L ^J^t?Ot>_LIiy L1UI1 

quality parameter) 


( image 


Photography condition 


j_» u.iiixiiciin-'c; LUiico nun 

processing parameter 




Photography part 


Chest 


FiasK size (norizoniai ana 
vertical) 


A 1 


fnoi.oyra.pny 
division 


C "i m t~\ ~l c± t~\ ~h\ k-\ -f— i~\ ex t~ arili ^ t 
O-Lllip JLti piiu LUyJ.CtjJliy 


Load coefficient 
(weight ) 


0.5 


JrOoLUXc/ Li_LX.tik_- 1 LU11 


Front 


Gradation processing 
parameter 




Method 


General 
photography 


Point A 


0.000 






Point B 


0.029 






Pot n+" C 

JT \J JL 11 u \j. 


0 117 






Point D 


0 . 260 






Point E 


0.436 






Point F 


0.670 






Point G 


0.880 






Point H 


0.970 






Point I 


1.000 






Frequency parameter 








Mask size (horizontal and 
vertical) 


21 






First load coefficient Wl 


0.4 






Second load coefficient W2 


-0.4 






Frequency emphasis type 


Z 






Lower limit value 


0.000 






Upper limit value 


1.000 
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Table 2 



Photography device 
type 


Device ABC 


Image processing condition 
quality parameter) 


( image 


Photography condition 


Luminance correction 
processing parameter 




Photography part 


Chest 


Mask size (horizontal and 
vertical } 


41 


Photography 
division 


Simple photography 


Load coefficient 
(weight ) 


0.6 


Posture /direct ion 


Side 


Gradation processing 
parameter 




Method 


General 
photography 


Point A 


0.000 






Point B 


0.029 






Point C 


0. 117 






Point D 


0.260 






Point E 


0.436 






Point F 


0.680 






Point G 


0.835 






Point H 


0.930 






Point I 


1.000 






Frequency parameter 

Mask size (horizontal and 
vertical) 


21 






First load coefficient Wl 


0.3 






Second load coefficient W2 


-0.3 






Frequency emphasis type 
Lower limit value 


Z 

0.000 






Upper limit value 


1.000 
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Table 3 



Photography device 
type 


Device ABC 


Image processing condition ( 
quality parameter) 


image 


Photography condition 


Luminance correction 
processing parameter 




Photography part 


Neck 


Mask size (horizontal and 
vertical ) 


31 


Photography 
division 


Simple photography 


Load coefficient 
(weight ) 


0 . 3 




Posture/ direction 


Side 


Gradation processing 
parameter 




Method 


General 
photography 


Point A 


0.000 






Point B 


0.110 






Point C 


0.280 






Point D 


0.520 






Point E 


0.740 






Point F 


0.850 






Point G 


0 .912 






Point H 


0.960 






Point I 


1.000 






Frequency parameter 








Mask size (horizontal and 
vertical) 


15 






First load coefficient Wl 


0.5 






Second load coefficient W2 


-0.5 






Frequency emphasis type 


F 






Lower limit value 


0.000 






Upper limit value 


1.000 
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The medical image subjected to the image processing 
in the image processing section 212 (output image) is 
inputted to an image display section 213, or transmitted to 
the outside via the output interface 117 shown in Fig. 2. On 
5 the hardware, the image display section 213 corresponds to 
the image display 120 shown in Figs. 1 and 2. 

The medical image displayed in the image display 
section 213, or the medical image transmitted to the outside 
and displayed in the outside is used for diagnosis. The 
l-p displayed medical image is a medical image subjected to the 

image processing by the image processing condition in 
t accordance with the photography device type and photography 
'3! condition, and is a preferable image for diagnosis 
U irrespective of a medical image type. 

f5 Moreover, in response to the operation, an image 

^ processing condition operating section 215 changes or deletes 

:| the image processing condition stored in the image processing 

condition storing section 218, or adds a new image processing 
condition to the image processing condition storing section 
20 218. 

Furthermore, an interested area designating section 
216 designates a desired area of interest on the medical 
image displayed in the image display section 213 in response 
to the operation. When the interested area designating 
25 section 216 designates the area of interest, the image 

display section 213 lowers a luminance of an area except the 
area of interest designated by the interested area 
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designating section and displays the medical image. In this 
case, the interested area designating section 216 also 
designates a coefficient indicating a degree of a drop of the 
luminance of the area except the designated area of interest 
5 in response to the operation, and the image display section 
213 lowers the luminance of the area except the area of - 
interest designated by the interested area designating 
section 216 down to the luminance in accordance with the 
coefficient designated by the interested area designating 
|||0 section 216 and displays the medical image. 
CI Additionally, the image processing apparatus 200 

V shown in Fig. 3 is also provided with a part recognizing 

l?i section 214, and the image processing section 212 is provided 

m 

: ^ with a function of performing the image processing on the 

{15 image processing condition for the part appearing in the 
^ designated area of interest when the area of interest is 

O designated by the interested area designating section 216. 

Here, the part recognizing section 214 automatically 
recognizes positions of a plurality of parts (e.g., lung 
20 field, rib, hear, and the like) appearing in one medical 
image (e.g., chest X-ray image). 

Furthermore, the image display section 213 is 
provided with a function of arranging and displaying the 
plurality of medical images. In this case, the image display 
2 5 section 213 applies the same area of interest as the area of 
interest designated by the interested area designating 
section 216 with respect to one medical image among the 
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plurality of medical images displayed in the image display 
section 213 to the plurality of medical images, and lowering 
the luminance of the area except the area of interest of each 
medical image to display the plurality of medical images . 
5 Additionally, the image processing apparatus shown 

in Fig. 3 is also provided with a scanning processing 
designating section 217. The scanning processing designating 
section 217 designates a scanning processing of setting the 
area of interest (typically a slit -shaped area of interest 
lip extending in a transverse or vertical direction) on the 
\j medical image displayed in the image display section 213 to 

V move the area of interest in a predetermined direction (e.g.. 

Ill 

|f l the vertical direction for a slit extending in the transverse 

Vi i 

7 direction) in response to the operation. 

fl5 When the scanning processing designating section 217 

H designates the scanning processing, the image display section 

y 213 displays the medical image constituted by successively 

moving the area of interest set by the scanning processing 
designating section 217 and lowering the luminance of the 
20 area except the area of interest. In this case, depending on 
a mode of designation by the scanning processing designating 
section 217, the image processing section 212 subjects the 
successively moving area of interest to the image processing 
in accordance with the part appearing in the successively 
25 moving area of interest among the parts recognized by the 
part recognizing section 214. 

The image display section 213 sets the same area of 
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interest in the same position at the same timing in response 
to the designation of the scanning processing by the scanning 
processing designating section 217, and can arrange and 
display the plurality of medical images whose areas of 
5 interest move synchronously with one another at the same 
speed. 

Fig. 4 is a detailed block diagram of the image 

processing section 212 in the image processing apparatus 

shown in Fig. 3. 
Up In the image processing section 212, a luminance 

lH correction processing 2121, a gradation processing 2122 , a 
V frequency processing 2123, and a histogram analysis and 

window level processing 2124 are executed. Details of these 

processings will be described later. 
ITS Additionally, when the image processing is performed 

H with respect to the area of interest designated by the 
Q interested area designating section 216 or the area of 

interest of the scanning processing designated by the 

scanning processing designating section 217, the histogram 
20 analysis and window level processing 2124 fails to be 

executed. 

These are measures taken to display the area of 
interest entirely in a low luminance state when the luminance 
of the entire area of interest is low, and to display the 
2 5 area of interest entirely in a high luminance state when the 
luminance of the entire area of interest is high. 

Fig. 5 is a diagram showing one embodiment of an 
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image processing program storage medium of the present 
invention . 

For an image processing program storage medium 300 
shown in Fig. 5, for example, the hard disk drive 113, CD-ROM 
5 11 and floppy disk 10 shown in Fig. 2 in a state in which an 
image processing program 310 is stored are representatively- 
shown, and in the image processing program storage medium 300, 
the image processing program 310 constituted of a data 
obtaining section 311, an image processing section 312, an 
r i0 image display section 313, a part recognizing section 314, an 
image processing condition operating section 315, an 
interested area designating section 316, and a scanning 
processing designating section 317 is stored. 

The image processing program storage medium 300 is, 
is for example, the CD-ROM 11 shown in Fig. 2 and placed in the 
~* state in which the image processing program 310 is stored, 

j and in this case, the CD-ROM corresponds to one embodiment of 

the image processing program storage medium of the present 
invention. When the image processing program 310 stored in 
20 the CD-ROM 11 is read by the CD-ROM drive 115, installed in 

the hard disk drive 113, and further executed by the CPU 111, 
the personal computer 100 shown in Figs. 1, 2 operates as one 
embodiment of the image processing apparatus of the present 
invention. The hard disk drive 113 in which the image 
25 processing program 310 is installed also corresponds to one 
embodiment of the image processing program storage medium of 
the present invention. When the image processing program 310 



installed in the hard disk drive 113 is downloaded to the 
floppy disk 10 by the FD drive 114 , the floppy disk in which 
the image processing program is stored also corresponds to 
one embodiment of the image processing program storage medium 
of the present invention. 

Here, the data obtaining section 311, image 
processing section 312, image display section 313, part 
recognizing section 314 , image processing condition operating 
section 315, interested area designating section 316, and 
scanning processing designating section 317 constituting the 
image processing program 310 shown in Fig. 5 correspond to 
the data obtaining section 211, image processing section 212, 
image display section 213, part recognizing section 214 , 
image processing condition operating section 215, interested 
area designating section 216, and scanning processing 
designating section 217 constituting the image processing 
apparatus 200 shown in Fig. 3, respectively. Additionally, 
the respective devices of the image processing apparatus 200 
of Fig. 3 refer to a combination of the hardware of the 
personal computer 100 shown in Figs. 1, 2 with software 
executed in the hardware. For the respective devices 
constituting the image processing program 310 shown in Fig. 5, 
even when the same names are used, only an application 
program portion is referred to among the hardware and 
software . 

Fig. 6 is an explanatory view of a principle of the 
luminance correction processing. Fig. 6A shows a state before 



- 30 - 



the luminance correction processing, and Fig. 6B shows a 
state after the luminance correction processing. The 
abscissa of Figs. 6A, 6B indicates a place of an image 
divided by an image density (lung field, mediastinum, 
diaphragm, and the like for the chest image), and the 
ordinate indicates a gradation value of the image. As seen 
from Fig. 6, with respect to a portion with a small gradation 
change, the image state before the processing (image 
gradation change state) is kept, and by narrowing a dynamic 
range only with respect to a portion with a large gradation 
change, an image can be obtained in which contrast fails to 
be visually lowered. 

A basic algorithm of the luminance correction 
processing for use herein is newly realized for medical image 
diagnosis by referring to a convolution algorithm 
internationally standardized by Part 2 Programmer's imaging 
kernel system application program interface of ISO/IEC 12087- 
2 Image Processing and Interchange (IPI). 

Fig. 7 is a flowchart of a luminance correction 
processing program for executing the luminance correction 
processing 2121 in the image processing section 212 shown in 
Fig. 4. 

First in a step a, the followings are inputted into 
the program: 

original image: S (x, y, z, t, b); 
impulse response array H(x, y) ; and 
load coefficient weight. 



Among these, the impulse response array H(x, y) and the load 
coefficient weight are image processing conditions for the 
original image S(x, y, z, t, b). 

Here, the original image S(x, y, z, t, b) denotes an 
image before the processing is executed (here, an image 
before a convolution processing is executed), and x, y, z, t, 
b of the original image S(x, y, z, t, b) denote a horizontal 
direction position, vertical direction position, depth, time, 
and band, respectively. Additionally, z (depth) denotes a 
case in which three-dimensional information obtained by MRI 
or the like is handled, t (time) denotes a case in which time 
information (dynamic image) of ultrasonic wave, endoscope or 
the like is handled, and b (band) denotes distinction of R, G 
B, for example, when an image of three colors R, G, B is 
handled. 

Moreover, the impulse response array H(x, y) denotes 
a mask provided with a uniform value here, and this array 
size (mask size) determines a frequency to be emphasized most 
among frequency components of the image. Specifically, when 
a large size mask is used, the image of low frequency 
components is emphasized. Conversely, when a small size mask 
is used, the image of high frequency components is emphasized 

By changing an unclear mask size in this manner, a 
frequency band important for diagnosis is emphasized, and a 
diagnosis image suitable for diagnosis purpose can be formed. 

For the chest image, the array size (mask size) 
applied in the luminance correction processing was set to a 
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mask size by which a low frequency component image following 
changes of rough structures such as the lung field and 
mediastinum film is emphasized. 

The load coefficient weight is a constant indicating 
5 a degree of luminance correction. 

Moreover, in step al of Fig. 7, it is inputted by an 
operation of an operator whether or not to perform an image 
boundary processing in convolution performed in step a4 . 
Also for the image boundary processing, instead of an 
1-10 operator's inputting for each time, the processing is stored 
Q beforehand one of the image processing conditions for the 

V photography condition, and presence/absence of the image 

''J* boundary processing as one of the image processing conditions 

i y may be inputted to the luminance correction processing 

f%5 program. 

f ? : In step a2, a luminance correction image D(x, y, z, 

GI t, b), filter image A(x, y, z, t, b), and luminance 

correction coefficient curve DRT are generated. In this step 
a2, with respect to the luminance correction image D(x, y, z, 
20 t, b) , and the filter image A(x, y, z, t, b) , only the array 
(area) is secured. 

Table 4 is a table showing a luminance correction 
coefficient table, and Fig. 8 is a chart showing a luminance 
correction curve. 
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Table 4 



Image gradation value point 


DRT value 


0,000 * image maximum pixel value 


0.500 *image maximum pixel value 


0.304 *image maximum pixel value 


0.091 *image maximum pixel value 


0.322 *image maximum pixel value 


0.070 *image maximum pixel value 


0.339 *image maximum pixel value 


0.053 * image maximum pixel value 


0.356 * image maximum pixel value 


0.038 *image maximum pixel value 


0.37 4 * image maximum pixel value 


0.024 * image maximum pixel value 


0.391 *image maximum pixel value 


0.015 *image maximum pixel value 


0.409 *image maximum pixel value 


0.008 * image maximum pixel value 


0.500 *image maximum pixel value 


0.000 *image maximum pixel value 


1.000 *image maximum pixel value 


0.000 * image maximum pixel value 



The luminance correction coefficient table shown in 
% Table 4 is stored beforehand, and in step a2 of Fig. 7 by 

jfb linearly interpolating between respective values of the 
luminance correction coefficient table, a luminance 
correction coefficient curve DRT is generated as shown by a 
% *l solid line of Fig 8. The abscissa of the luminance 

O correction coefficient curve shown in Fig. 8 indicates an 

10 image gradation value (normalized density of each point), and 
the ordinate indicates an DRT value indicative of a degree of 
luminance correction. Additionally, a dashed line shown in 
Fig 8 shows another luminance correction coefficient curve. 

It is judged in step a3 of Fig. 7 whether or not the 
15 processing of the next steps a4, a5 ends with respect to the 
whole area of the image. When the processing has not ended 
yet with respect to the whole area, the next one pixel is 
subjected to the processing of the steps a4 , a5 . When the 
processing of the steps a4 , a5 has ended with respect to the 
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whole area of the image, this luminance correction processing 
ends . 

In the step a4 # the convolution processing is 
performed with respect to one pixel noted at present. 
In step a4, 

A(x, y, z, t, b) = S(x, y, z. t, b)(*)H(x, y) 

... (1) 

indicates a processing of setting an average value of pixel 
values in an area of H(x, y) centering on one pixel noted at 
present anew as the pixel value of one noted pixel, and the 
filter image A(x # y, z, t, b) becomes a blurred image with a 
reduced high frequency component by the aforementioned 
calculation . 

In the step a5 , the luminance correction processing 
is performed with respect to one pixel noted at present . In 
step a5, for 

D{x, y, z, t, b) = S(x, y, z, t, b) 

+ weight*DRT{A(x, y, z, t, b)} ... (2), 
DRT{A(x, y, z, t, b)} indicates a DRT value (see Fig. 8) for 
the pixel value of the filter image A(x, y, z, t, b) of the 
presently noted pixel, and the equation (2) means that the 
DRT value weighted by the coefficient weight is added to the 
pixel value of the same pixel of the original image S(x, y, z, 
t, b). By employing the DRT curve shown by a solid line in 
Fig. 8 in this manner, the luminance correction processing 
shown in Fig. 6 is realized. In the luminance correction 
processing shown in Fig. 6, the luminance of a high luminance 



(whitish) portion is lowered, but by employing the DRT curve 
shown by the dashed line of Fig. 8, the luminance of a low 
luminance (blackish) portion is raised. 

Fig. 9 is a flowchart showing a convolution 
processing routine in the step a4 of Fig. 7. 

In step bl, an image boundary determination is 
performed. Specifically, when the mask H(x, y) is superposed 
on the original image centering on the presently noted one 
pixel, it is judged whether or not a portion of the mask H(x, 
y) is out of an original image end. 

When the mask fails to overlap (fails to stick out 
of) a boundary, the processing advances to step b2 to judge 
whether or not the processing of step b3 is performed with 
respect to the whole area of the mask H(x, y) , in step b3 the 
original image S(x, y, z, t, b) is multiplied by the mask H(x, 
y) for each pixel with respect to the whole area of the mask 
H(x, y) and a multiplication result is accumulated as the - 
value of one presently noted pixel of the filter pixel A(x, y, 
z , t , b) . 

When accumulation ends with respect to the whole 
area of the mask H(x, y) , the processing advances to step b8 
to perform a scale factor processing of returning the 
accumulated value obtained by accumulation back to the 
average value with one pixel, and the convolution routine is 
exited. 

In the step bl, it is determined that the mask H(x, 
y) sticks out of the boundary of the original image S(x, y, z. 
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t, b) with respect to the presently noted one pixel, then the 
processing advances to step b4, and it is judged in the step 
b4 whether or not performing of a boundary processing is 
designated. When no boundary processing is performed, the 
5 processing advances to step b9 , the pixel value of the 

original image is employed as it is as the pixel value of the 
filter image with respect to the presently noted one pixel, 
and the convolution processing routine is exited. 

When it is determined in the step b4 that the 
|:|0 boundary processing is performed, the processing advances to 
%l step b5 to judge whether or not the next two steps b6, b7 end 

> with respect to the whole area of the mask H(x, y) . 

Ifi In the step b6 the boundary processing is performed, 

and in the step b7 accumulation is performed similarly as the 
ri5 step b3 with respect to the image subjected to the boundary 
processing. 

y A boundary processing method employed in the step b6 

is realized by referring to a reflected exterior mode 
algorithm of convolve_2d internationally standardized by Part 

20 2 Programmer's imaging kernel system application program 

interface of ISO/IEC 12087-2 Image Processing and Interchange 
(IPI). The boundary processing is a processing of turning 
back the pixel value in the so-called original image boundary 
in such a manner that linear symmetry is obtained, and 

25 increasing the pixel to the outside of the boundary of the 
original image . 

When the accumulated value is obtained with the 
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presently noted one pixel in the step b5, the processing 
advances to step b8, and the average value is obtained in the 
step b8 . 

The blurred filter image A(x, y, z, t, b) is 
5 generated as the image as described above. 

Additionally, it is determined whether or not to- 
perform the boundary processing on the basis of whether or 
not the image including meaningful information spreads to a 
peripheral edge area of the original image. When the 
meaningful information spreads to the peripheral edge area, 
'f\ even with much time required for the image processing, it is 
s * preferable to perform the boundary processing. When there is 
H little meaningful information in the peripheral edge area, it 

^ is preferable to omit the boundary processing and shorten the 

!f5 time required for the image processing. 

U Fig. 10 is a flowchart of a gradation processing 

O program for executing the gradation processing 2122 in the 

image processing section 212 shown in Fig. 4. 

In step cl, the original image (image before the 
20 gradation processing) S(x, y, z, t, b) , and non-linear 

conversion curve data LOOK{} are inputted. The non-linear 
conversion curve data LOOK{} is a lookup table prepared as 
described later based on a gradation processing parameter 
(points A to I) of the image processing condition (refer to 

25 Tables 1 to 3) . 

In step c2, a gradation processing image D(x, y, z, 
t, b) is formed. Additionally, this means that the area for 
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the gradation processing image is secured, and respective 
pixel values of the gradation processing image are prepared 
in step c4. 

It is judged in step c3 whether or not the 
5 processing of the step c4 ends over the whole range of the 
image, and when the processing has not ended yet, the 
processing of the step c4 is performed for each pixel. 

In the step c4 , the non-linear conversion curve data 
LOOK{} of the lookup table form is referred to and conversion 
34) of each pixel value is performed. 

;M Fig. 11 is a graph showing a correspondence between 

the pixel value of the original image and the pixel value of 
I|l a gradation conversion image. 

Ill with respect to the original image (abscissa), from 

W5 0.0 (minimum density) to 1.0 (maximum density), nine points 
y> (points A to I) are taken at equal intervals, and for the 

l:| gradation conversion image (ordinate) , the gradation 

processing parameter (points A to I) of the image processing 
condition is applied to each point. When these nine points 
20 are smoothly connected by a spline curve, the non-linear 

conversion curve data LOOK{ } is formed. The spline curve is 
realized by referring to the algorithm of a scroll periodic 
spline curve of "Scientific Technical calculated by revised C 
published by CQ Company and authored by Shinichi Koike . " 
25 Fig. 12 is a flowchart showing a non- linear 

conversion curve data preparation processing. 

First in step dl , coordinate values of nine points 
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(points A to I) of x-axis (original image) and y-axis 
(gradation conversion image), and a division interval value 
between data are inputted, and the storage area LOOK{ } of the 
non-linear conversion curve data is secured. 
5 In order to prepare the spline curve, since 

different processings are necessary in both ends and middle, 
in step 6.2 the non-linear conversion curve data of a first 
division (between the points A and B) is generated, in step 
d3 the non-linear conversion curve data of a middle division 
i=0 (between the points B and H) is generated, and in step d4 the 
ijl non-linear conversion curve data of the last division 

(between the points H and I) is generated* 
ttl In step cl of Fig. 10, the non- linear conversion 

W curve data LOOK{ } prepared beforehand in this manner is 

If5 inputted, or in the step cl the non- linear conversion curve 
H data LOOK{ } is prepared. 

g The frequency processing 2123 in the image 

processing section 212 shown in Fig. 4 will next be described. 
Fig. 13 is a chart showing a frequency coefficient 

20 showing a degree of frequency emphasis with respect to the 
gradation value of the original image. 

A frequency emphasis type F means that a frequency 
coefficient is always 1.0 irrespective of the gradation value 
of the original image, a frequency emphasis type Z means that 

25 with a larger gradation value of the original image (with a 

higher image density (with a lower luminance)), the frequency 
emphasis is performed more strongly, and a frequency emphasis 
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type Y means that with a smaller gradation value of the 
original image (with a lower image density (with a higher 
luminance)), the frequency emphasis is performed more 
strongly. As shown in Tables 1 to 3, the frequency emphasis 
5 type is designated as one of the image processing conditions. 

Additionally, lower and upper limit values of an. 
original image density area (luminance area) for performing 
frequency emphasis can be set as shown by a dashed line Z ' of 
Fig. 13, and the frequency emphasis is performed only in the 
area held between the lower limit value and the upper limit 
value . 

\I Fig. 14 is a flowchart of a frequency processing 

"Jf program. 

First in step el, 
afs original image (image before a frequency processing) 

H S(x, y, z, t, b), 

rj impulse response array (uniform mask herein) H(x, y) , 

load coefficients Wl , W2 , 

frequency emphasis type (any one of F, V, Z), and 
20 an instruction as to whether or not to perform a 

convolution image boundary processing are inputted. Among 
these, the impulse response array H(x, y) is designated as a 
mask size in the image processing condition, and the load 
coefficients Wl , W2 and frequency emphasis type are also 
25 designated as the image processing conditions. 

The convolution image boundary processing is 
optional here, and is constituted in such a manner that an 
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operator gives an instruction for each image processing, but 
designation of whether or not to perform the image boundary 
processing may be designated beforehand as one of the image 
processing conditions . 

In step e2, the image subjected to the frequency 
processing (frequency processing image) D(x, y # z, t, b) r low 
pass filter image A(x, y, z, t, b), and frequency emphasis 
coefficient table RT are generated. With respect to the 
frequency processing image D(x, y, z, t, b) and low pass 
filter image A(x, y, z, t, b) , it is meant that in the step 
e2 an area for storing the images are secured, and actual 
data is prepared in steps e4, e5 . The frequency emphasis 
coefficient table RT is formed by obtaining the coefficients 
for respective gradation values with respect to the frequency 
emphasis type (e.g., frequency emphasis type Z for Table 1) 
designated in accordance with the image processing condition 
among some frequency emphasis types F, Y, Z shown in Fig. 13 
and arranging data in a table form. 

It is judged in step e3 whether or not the 
processing of steps e4, e5 to be performed for each pixel 
ends with respect to the whole range of the image, and the 
processing of the steps e4, e5 is performed for each pixel 
with respect to the respective pixels in the whole range. 

The step e4 corresponds to convolution, and has 
already been described with reference to Fig. 9, and 
redundant description is omitted here. As a result of 
convolution, so-called blurred image A(x, y, z, t, b) with a 



reduced high frequency component is formed. 

In step e5, the frequency processing is performed in 
accordance with: 

D(x, y, z, t, b) = S(x, y, z, t, b) 
+ (Wl*RT[S(x, y, z, t, b)]*S(x, y, z, t , b) 
+ W2*RT[S(x, y, z, t, b)]*A(x, y, z, t , b) 

... (3) 

In this equation (3) RT[S(x, y, z, t, b)] is a 
frequency coefficient (ordinate of Fig. 13) corresponding to 
the pixel value (abscissa of Fig. 13) of the original image 
S(x, y, z, t, b) of the presently noted pixel. 

In the equation (3) WT*RT[S(x, y, z, t, b)]*S(x, y, 
z, t, b) means that RT[S(x, y, z, t, b) ] obtained as 
described above is multiplied by the load coefficient Wl , and 
further multiplied by the pixel value of the original image 
S(x, y, z, t, b) of the noted pixel. 

Moreover, similarly, in the equation (3) W2*RT[S(x, 
y, z, t, b)]*A(x, y, z, t, b) means that RT[S(x, y, z, t, b) ] 
is multiplied by the load coefficient W2, and further 
multiplied by the pixel value in the low pass filter image 
A(x, y, z, t, b) of the noted pixel. 

Therefore the equation (3) means that Wl*RT[5(x, y, 
z, t, b)]*S(x, y, z, t, b) and W2*RT[S(x f y, z, t, b)]*A(x, y # 
z, t, b) are added to the pixel value of the noted pixel of 
the original image S(x, y, z # t, b) . Here, the load 
coefficient W2 is provided with a minus value, and the 
equation (3) is therefore a calculation equation for reducing 



- 43 - 



the blurred image component (low frequency component) to 
emphasize the high frequency component. 

Here, when the frequency processing is performed 
only with constants Wl , W2 without using an idea of the 
5 frequency emphasis type, emphasis is performed with respect 

to the whole density area at a fixed proportion, but with the 
chest image, a noise is amplified in the low density areas 
such as the mediastinum and diaphragm to inhibit image 
diagnosis, or in the lung field a lung tigroid or another 
normal structure is probably incorrectly diagnosed as an 
fl abnormal observation by excessive emphasis. Therefore, here, 

*T* the defect is removed by introducing the idea of the 
l ]z frequency emphasis type. 

Ill The histogram analysis and window processing 2124 in 

k~5 the image processing section 212 shown in Fig. 4 will next be 
H described. 

Q Fig. 15 is a flowchart of a histogram analysis and 

window processing program. 

Here, first in step fl, the original image (image 
20 before this processing is performed) S(x, y, z, t, b) is 

inputted, and in step f2, histogram analysis of the original 
image is performed to detect maximum and minimum pixel values 
and based on the values a window width (maximum pixel value - 
minimum pixel value) width, and center value ((maximum pixel 
25 value + minimum pixel value )/2) center are calculated. 

In step f3, density conversion processing image D(x, 
y, z, t, b) and density conversion table LOOK{ } are generated 



Additionally, this step f3 means that the area for storing 
these is secured, and actual data is prepared for the density 
conversion table LOOK{ } in step f5 and for the density 
conversion processing image D(x, y f z, t, b) in step f7. 

It is judged in step f4 whether or not a window 
level processing in step f5 ends with respect to the whole 
density range, and when the processing has not end yet, the 
density conversion table LOOK{e} of the lookup table form is 
successively prepared for each density in accordance with 
the following: 

LOOK{e} = (e/width - center/width +0.5) 

*d_MAX ... ( 4 } 

For this density conversion table LOOK{}, for 
example, when the original image S(x, y, z, t, b) is 
displayed in the display screen 121 of the image display 120 
shown in Fig. 1, the maximum density of the original image is 
converted to the maximum density (minimum luminance) d__MAX 
which can be represented on the image display screen 121, and 
the minimum density of the original image is converted to the 
minimum density (maximum luminance) 0.0 which can be 
represented on the density screen 121. 

In step f5, the density conversion table LOOK{} is 
successively prepared for each density value, and the 
processing ends with respect to the whole density range and 
then advances to step f6. 

It is monitored in the step f6 whether or not the 
density conversion processing of step f 7 ends with respect to 



the whole pixel range of the original image. When the 
processing has not ended yet, the processing advances to the 
step f7. The density conversion table LOOK{ } is referred to 
for each pixel and the original image S(x, y, z, t, b) is 
converted to the density conversion processing image D(x, y, 
z, t, b). 

The density conversion processing image D(x, y, z, t, 
b) prepared in this manner is outputted from the image 
processing section 212 shown in Figs. 3, 4 as an output image, 
and the output image is inputted, for example, to the image 
display section 213 shown in Fig. 3, and displayed/output ted, 
for example, on the display screen 121 shown in Fig. 1 as the 
image for diagnosis. 

Here, as described above, by performing the image 
processing based on the image processing condition in 
accordance with the photography device type and photography 
condition of the medical image as described above, the output 
image superior in diagnosis aptitude can constantly be 
obtained irrespective of the medical image type. 

Fig. 16 is a chart showing one example of a 
processing effect according to the present embodiment. 

Here, 23 cases in total of 15 cases of lung node 
patients (abnormal people) and 8 cases of normal patients in 
CR chest images were used and a radiography specialist of a 
radiation department experimented a digital image subjected 
to the image processing using the film and the present 
invention by a receiver operating characteristic 



- 46 - 



analysis /evaluation method. 

Fig. 16 is a chart showing the experiment result. A 
way of looking at Fig. 16 will be described. 

Y-axis (TPF) of Fig. 16: a ratio at which 
5 abnormality is correctly judged as presence of abnormality. 

X-axis (FPF) of Fig. 16: a ratio at which normality 
is incorrectly judged as presence of abnormality. 

It is assumed by Fig. 16 that the closer an ROC 
curve approaches TPF = 1.0, FPF = 0.0, the better the 
1X30 characteristic becomes. In an ideal state, presentation of 
SI abnormality is necessarily judged as the presence of 

abnormality, presentation of normality is necessarily judged 
;p as the presence of normality, and the abnormality can 

K completely be distinguished from the normality. 

|15 Moreover, Az in Fig. 16 is an area below the ROC 

G curve, and Az equals 1.0 with TPF = 1.0, FPF = 0.0. 

% Therefore, from the result of Fig 16, as compared 

with the film, the digital image subjected to the image 
processing using the present embodiment obtains a better 
20 result in diagnosis ability, abilities to extract a fine 

structure of a lung blood vessel and a mediastinum structure 
are enhanced, and an ability to detect a pathological change 
is effectively enhanced. 

A mode of the basic image processing in the image 
25 processing section 212 of the image processing apparatus 200 
shown in Fig. 2 has been described above, and modes of 
various operations and displays in the image processing 
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apparatus 200 will be described hereinafter. 

Fig. 17 is a flowchart showing registration and 
reuse of an image quality parameter for defining an image 
initial display and image processing condition. 
5 Here, first the original image as a processing 

object (input image described with reference to Fig. 3) and 
the photography device type and photography condition when 
the original image is obtained are inputted (step gl). As 
described above, the original image and the photography 
JJD device type and photography condition form one object. In 
l k i the hard disk drive 113 of Fig. 2, a large number of objects 
^; are stored, and here the user opens a graphic user interface 
111 (GUI) screen (not shown) in which a list of objects is 
111 displayed to select a desired object on the screen. 
fe5 In this manner, the object is read from the hard 

f«* disk drive 113 and inputted into a routine shown in Fig. 17. 
Q Additionally, it is assumed here that only one object is 
™ selected, but a plurality of medical images are arranged and 

displayed simultaneously, for example, as shown in Fig. 25, 
20 and in this case the plurality of arranged and displayed 
objects are selected. 

Moreover, when entering the routine, user 
authentication is performed by inputting a password or the 
like, and the image processing apparatus is also provided 
25 with information on the user. 

In the image processing condition storing section 
218 of the image processing apparatus 200 shown in Fig. 3, 
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image quality parameters for determining a large number of 
image processing conditions are stored. In the image 
processing condition storing section 218, as described above, 
in addition to the image processing conditions (image quality 
5 parameters) for the photography device types and photography 
conditions, a large number of image processing conditions 
(image quality parameters) such as image processing 
conditions for one photography device type and photography 
condition and for a plurality of parts appearing in one 

£p medical image (e.g., lung field, mediastinum, rib, heart, 

J:1 diaphragm, and the like in the chest simple radiograph) are 
associated with the respective users and stored. 

?l* In step g2 of Fig 17, from a large number of image 

,w quality parameters (image processing conditions), the image 
quality parameter as an initial value associated with the 

h- user using the image processing apparatus 200 (refer to Fig. 

O 3) and the photography device type and photography condition 
in the object inputted in the step gl or the image quality 
parameter employed in the past is extracted, in step g3 the 

20 original image in the object inputted in the step gl is 

subjected to an image quality adjustment processing (image 
processing) in accordance with the image quality parameter 
extracted in the step g2, and in step g4 an initial image 
after the image quality adjustment processing (image 

25 processing) is displayed. Here, the image quality adjustment 
processing (image processing) includes various processings 
described with reference to Fig. 4. 
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Subsequently, when there is an unsatisfactory 
respect in the quality of the displayed medical image, the 
image quality parameter is adjusted to perform the image 
quality adjustment processing {step g5 ) , and a processing of 
5 registering a finally obtained optimum image quality 

parameter is performed (step g6). Thereby, the image quality 
parameter optimum for the user is associated with the 
photography device type and photography condition and with 
the user and registered. 
10 Fig. 18 is a diagram showing one example of the 

13 initial display image displayed in the step g4 of Fig. 17. 
H This image is displayed on the display screen 121 of the 

V image display 120 shown in Fig. 1 by the image display 

IE section 213 of the image processing apparatus 200 shown in 
15 Fig. 3. 

f[ Here, displayed are a chest front simple radiograph, 

C and buttons of "file (F)", "image (I)", and "tool (T)" above 

% the radiograph, to which a click operation by a mouse is 

performed. 

20 When mouse-clicking the button "file (F)", a button 

"exit (X)" is displayed. The button "exit (X)" means the end 
of this application, and by mouse -clicking the button "exit 
(X)", an end confirmation message box is displayed. 

By clicking the button "image (I)", an image quality 
25 adjustment dialog box is displayed. Details of the image 
quality adjustment dialog box will be described later. 

When the button "tool (T)" is clicked, buttons 



in 
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"scanning processing (S)" and "masking (M)" are displayed. 
When the button "scanning processing (S)" is mouse-clicked, a 
scanning dialog box is displayed. On the other hand, by 
clicking the button "masking ( M ) " , a masking dialog box is 
displayed. Details of the scanning dialog box and masking 
dialog box will be described later. 

The image quality dialog box is provided with tags 
"gradation processing", "luminance correction processing", 
"frequency processing", and "basic processing". For Figs. 19 
to 22, Fig. 19 shows a screen displayed by mouse-clicking the 
tag "gradation processing" , Fig. 20 shows a screen displayed 
by mouse-clicking the tag "luminance correction processing", 
Fig. 21 shows a screen displayed by mouse -clicking the tag 
"frequency processing", and Fig. 22 shows a screen displayed 
by mouse-clicking the tag "frequency processing" "basic 
processing" . 

The "gradation processing" is a screen for adjusting 
the image quality parameter (gradation processing parameter; 
see Tables 1 to 3) for the gradation processing, "luminance 
correction processing" is a screen for adjusting the image 
quality parameter (luminance correction processing parameter; 
see Tables 1 to 3) for the luminance correction processing, 
"frequency processing" is a screen for adjusting the image 
quality parameter (frequency parameter; see Tables 1 to 3) 
for the frequency processing, and "basic processing" is a 
screen for the basic processing (preset selection). 

In the screen for adjusting the "gradation 
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processing" shown in Fig. 19, a curve 501 showing a 
correspondence between the pixel value of the original image 
(image before the gradation conversion processing here) and 
the pixel value of the gradation conversion processing image 
5 also shown in Fig. 11, and a histogram 502 of the pixel value 
of the original image are displayed, and on the right side a 
combo box 503 for adjusting the value of the curve 501 
(points A to I) is displayed. By inputting a numeric value 
directly into the combo box 503 for adjusting the value, or 
10 mouse-clicking mark "A" "V" for adjusting the value, the 
□ value is adjusted. Alternatively, by picking and vertically 
%l moving the respective points A to I of the curve 501, the 
g; numeric value is displayed in the value adjusting combo box 

0 503 and the curve 501 is changed to a curve in accordance 

,15 with the numeric value. 

^ By adjusting the curve 501 in this manner and 

*s clicking an "update" button 504, the original image (original 

2 image inputted in the step gl of Fig. 17) of the displayed 

medical image (see Fig. 18) is subjected to a series of image 
20 quality adjustment processings including the gradation 

processing in which the gradation processing parameter after 
the adjustment is reflected, and the displayed medical image 
(see Fig. 18) is replaced with the medical image after this 
present image quality adjustment. The user can therefore 
25 confirm an influence of this parameter adjustment on the 

display image. 

Fig. 19 further shows an "initialize" button 505, 
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"new storage" button 506, "storage" button 507, and "exit" 
button 508, and these buttons will be described later in 
detail . 

Fig. 20 shows the screen displayed by mouse-clicking 
5 the tag "luminance correction processing". 

Fig. 20 only shows the tag "luminance correction 
processing", and omits but shows the respective tags "basic 
processing", "frequency processing", and "gradation 
processing" similarly as Fig. 19, and also shows the 
10 respective buttons 505 to 508 of "initialize", "new storage", 

19 "storage", "exit" in a bottom similarly as Fig. 19. 

Cj In the screen of Fig. 20, a parameter adjusting 

j; combo box 511 and type selecting combo box 512 appear, and in 

In the parameter adjusting combo box 511 the load coefficient 

'l5 (0.0 to 10.0) and mask size (3 to 127} are adjusted. The 
ft load coefficient indicates a value of coefficient weight of 
H the equation (2) used in the description of the luminance 

O correction processing, and the mask size indicates the size 

of H(x, y) appearing in the equation (1). 

20 Moreover, in the type selecting combo box 512, any 
curve shown in Fig. 8 (a solid- line curve and a dashed- line 
curve are shown here) is selected. 

By mouse-clicking an "update" button 514, the 
original image inputted in the step gl of Fig. 17 is 
25 subjected to the image quality adjustment processing in which 
the presently adjusted parameter for the luminance correction 
processing is reflected, and instead of the displayed medical 
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image shown in Fig. 18 , the medical image subjected to the 
presently newly performed image quality adjustment processing 
is displayed. 

Fig. 21 shows a screen displayed by mouse- clicking 
5 the tag "frequency processing", and in these screens, the 
parameter for the frequency processing is adjusted. 

Fig. 21 only shows the tag "frequency processing", 
and omits similarly as Fig. 20 but shows the respective tags 
"basic processing", "luminance correction processing", and 

10 "gradation processing" similarly as Fig. 19, and also shows 
CI the respective buttons 505 to 508 of "initialize", "new 

SI storage", "storage", "exit" in the bottom similarly as Fig. 

;p 19. 

I|l In the screen of Fig. 21, a parameter adjusting 

15 combo box 521, type selecting combo box 522, and upper and 
C lower limit value adjustment columns 523 appear, and in the 

11 parameter adjusting combo box 521 the load coefficient (-10.0 
to 10.0) and mask size (3 to 127) are adjusted. The load 
coefficient indicates values of coefficients Wl , W2 

20 (additionally W2 = -Wl ) of the equation (3) used in the 

description of the frequency processing, and the mask size 
indicates the size of the impulse response array H(x, y) . 

Moreover, the type selecting combo box 522, any 
frequency emphasis type is selected from a plurality of 

25 frequency emphasis types shown in Fig. 13, and in the upper 

and lower limit value adjustment columns 523, the lower limit 
value (Lower) and upper limit value (Upper) to which the 
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selected frequency emphasis type is applied are adjusted. 

By mouse-clicking an "update" button 524, the 
original image inputted in the step gl of Fig. 17 is 
subjected to the image quality adjustment processing in which 
5 the presently adjusted parameter for the frequency processing 
is reflected, and instead of the displayed medical image 
shown in Fig. 18, the medical image subjected to the 
presently newly performed image quality adjustment processing 
is displayed. 

10 Fig. 22 shows the screen displayed by mouse-clicking 

CI the tag "basic processing", and in these screens the buttons 

%| common with the respective tags are arranged. 

V Fig. 22 only shows the tag "basic processing" for 

III reasons similar to those of Figs. 20, 21, also shows the 

*15 respective tags of "frequency processing", "luminance 

I*[ correction processing", and "gradation processing" similarly 

l) as Fig. 19, and also shows the respective buttons 505 to 508 

of "initialize", "new storage", "storage", "exit" in the 

bottom. 

20 In the screen of Fig. 22, a photography condition 

selecting combo box 531 and parameter adjusting combo box 532 
are displayed. In the photography condition selecting combo 
box 531 the photography condition is selected, and in the 
parameter adjusting combo box 532 the image quality is 

25 selected. The "image quality" is here associated with a 

plurality of parts (e.g., lung field, mediastinum, rib, heart 
diaphragm, and the like) appearing in one medical image (e.g. 
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the chest X-ray image). 

When clicking a "delete" button 533, the parameters 
of the gradation processing, luminance correction processing, 
and frequency processing concerning the part selected by the 
parameter adjusting combo box 532 are deleted. 

Moreover, by clicking an "update" button 534, the 
medical image subjected to the image quality adjustment 
processing by the presently set image quality parameter is 
displayed . 

Here, the respective update buttons 504, 514, 524, 
534 of Figs. 19 to 22 constitute the same action, and even by 
mouse-clicking the update button in any screen, the image 
quality adjustment processing is performed in which all the 
parameters of the latest adjusted gradation processing, 
luminance correction processing, and frequency processing are 
reflected. 

Furthermore, by mouse -clicking the "initialize" 
button 505 representatively shown in Fig. 19, the image 
quality parameters before mouse -clicking the presently 
adjusted "storage" button 507 (or "new storage" button 506) 
are all returned back to original values. 

Additionally, by mouse-clicking the "new storage" 
button 506, the adjusted image quality parameter is 
associated with the photography condition and part ("image 
quality") set in the basic processing screen (see Fig. 22), 
and a new image processing condition is prepared as 
illustrated in Tables 1 to 3 . 
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Moreover, by mouse-clicking the "storage" button 507, 
the initial image processing condition extracted in the step 
g2 of Fig. 17 is rewritten to the image processing condition 
provided with the presently adjusted image quality parameter. 
5 The "exit" button 508 closes the image quality 

adjustment combo box (Figs. 19 to 22). 

In the present embodiment, as described above, tfie 
image quality parameter (image processing condition) is added, 
updated , or deleted . 
10 Fig. 23 is a diagram showing the masking dialog box. 

13 The masking dialog box is displayed by mouse-clicking the 
Si "tool (T) " button on the screen of Fig. 18, and clicking the 

!g "masking (M) " button among the displayed buttons. 

% In the masking dialog box shown in Fig. 23, a mask 

!fs parameter setting column 541 and image quality combo box 542 
fT are displayed. These will be described later. 

l*\ Fig. 24 is a diagram showing one example of the 

Q medical image subjected to a masking processing. 

When the masking processing is performed, the 
20 original image is displayed only in a set area of interest 
543, and a dark image with the lowered luminance for the 
designated coefficient (mask level) is displayed in the area 
except the area of interest 543. 

Turning back to Fig. 23, the masking dialog box of 
25 Fig. 23 will be described. 

In the mask parameter setting column 541 of the 
masking dialog box, a shape of the area of interest (mask 
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shape; rectangular or circular), brightness of the area 
except the area of interest (mask level), dimension of the 
area of interest (mask size X, mask size Y) , magnification of 
the image in the area of interest, and on/off of "synchronous 
5 link" (described later) are set. The center point of the 

area of interest is designated by placing a mask cursor in a 
desired position on the screen shown in Fig. 18 and clicking 
the cursor. 

Fig. 25 is a diagram showing that two medical images 
10 are arranged and displayed. 

p This embodiment is provided with a mode in which in 

Q the step gl of Fig. 17 another image (comparative image) is 
V; inputted together with the original image, and these two 

medical images are arranged and displayed as shown in Fig. 25. 
15 In this case, by turning on the "synchronous link", a 
C[ "synchronous link processing" is performed, the position and 

H dimension of the area of interest designated with respect to 
Jff the original image are also effective with respect to the 

comparative image, and the same area of interest is set with 
20 respect to two medical images. In this manner, the past and 

present images of the same patient are arranged, compared 

with each other and observed, which is convenient for 

observation . 

Moreover, in the image quality combo box 542 of the 
25 masking dialog box of Fig. 23, "image quality", "image 

quality application", "automatic recognition application" are 
set . 



- 58 - 



For the "image quality", with respect to the area of 
interest, it is designated the image quality parameter for 
performing the quality adjustment processing among a 
plurality of image quality parameters , each of which 
5 parameters is suitable for observation of each part selected 
from a plurality parts of a body. 

Moreover, for the "image quality application", with 
respect to the designated area of interest, it is selected 
whether the image quality adjustment processing using the 
10 image quality parameter selected in the "image quality", or 
13 simply the masking processing of the original image is to be 
%| performed. 

JI Furthermore, when the "automatic recognition 

processing" is turned on, the part appearing in the area of 
Jf5 interest of the display image is automatically recognized, 
[T and the image quality adjustment processing is performed in 
\\ accordance with the recognized part and reflected in the 
J::J display image. In his case, even when the part is designated 

in the column of "image quality", the automatically 
20 recognized part has priority. 

Fig. 26 is a flowchart of the masking processing. 
Here, first the original image, and various 
parameters or flags for the masking processing are inputted, 
and the comparative image is also inputted as occasion 
25 demands (step hi). Among these, the original image and 

comparative image are inputted beforehand in the step gl of 
Fig. 17, and the parameter and flag are inputted on the 
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masking dialog box of Fig. 23. 

In the next step h2 , a mask image is generated as 

follows . 

The original image is set to S(x, y, z, t, b), and 
5 the mask image is set to D(x, y, z, t, b). Here, as 

described above, x, y, z, t, b denote the position of the 
horizontal direction, position of the vertical direction; 
depth, time, and band, respectively. The z (depth) indicates 
a case in which three-dimensional information obtained by MR I 
10 or the like is handled, t (time) denotes a case in which time 
m information (dynamic image) of ultrasonic wave, endoscope or 
Ij the like is handled, and b (band) denotes distinction of R, G 
"p B, for example, when an image of three colors R, G, B is 
[Z handled. 

Ts Moreover, when the mask level (0.0 to 1.0) is set to 

5~ Level, and black pixel value is set to Black, the mask image 

D(x, y, z, t, b) is formed based on the following equation: 
Q D(x, y, z, t, b) = (1.0-Level)»S(x, y, z, t, 

b ) + ( Level # Black ) . . . ( 5 ) 

20 The mask image D(x, y, z, t, b) is an image in which the 

luminance of the original image S(x, y, z, t, b) is lowered 

in accordance with the mask level Level. 

It is judged in step h3 whether an automatic part 

recognition processing application flag is on/off. When the 
25 automatic part recognition processing flag is on, in step h4 

the automatic part recognition processing is executed. The 

automatic part recognition processing will be described later 
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Moreover, it is judged in step h5 whether an image 
quality adjustment processing application flag is on/off. 
When the flag is on, the processing advances to step h6 to 
execute the image quality adjustment processing. 
5 Furthermore, in step h7 , an enlargement/reduction 

processing of the area of interest is performed, and in step 
h8, the potion of the area of interest in the mask image 'is 
replaced with the image (image of area of interest) 
constituted by extracting only the area of interest after the 

10 image quality adjustment processing. 

p Additionally, it is judged in step h9 whether a 

%l synchronous link processing application flag is on/off. When 

j:. the flag is on, in step hlO, also the comparative image is 

Iq subjected to the processing of steps h2 to h8 . 

Jfs In step hll, the image subjected to the masking 

JQ processing in this manner is displayed. 

11 It is judged in step hl2 whether the next mouse 
;d operation for the user indicates the end of the masking 

processing, or the instruction for the new masking processing 
20 of designating a new area of interest. In an end processing, 

this masking processing is ended, the masking image is closed, 

and the usual display image without any masking is recovered. 

When the new masking processing is designated, the processing 

returns to the step h3 . 
25 The image in which the area of interest is easily 

observed is displayed by the aforementioned masking 

processing. 



- 61 - 



Fig. 27 is a diagram showing a scanning dialog box. 
This scanning dialog box is displayed by mouse-clicking the 
"tool (T)" button on the screen of Fig. 18, and clicking 
"scanning (S) button among the displayed buttons. 
5 In the scanning dialog box shown in Fig. 27, a 

scanning parameter setting column 551 and image quality combo 
box 552 are displayed. These will be described later. 

Fig. 28 is a diagram showing the display image 
subjected to the scanning processing. 

10 When the scanning processing is performed, only an 
S area of interest 553 is displayed, and the area except the 
%l area of interest 553 is masked. The area of interest 553 is 
£ scanned downward from the top of the screen in the example 

Iq shown in Fig. 28. 

[l5 Turning back to Fig. 27, the scanning dialog box of 

Ll Fig. 27 will be described. 

11 In the scanning parameter setting column 551 of the 
}£ scanning dialog box, a scan direction (vertical direction or 

Ik: 3 

horizontal direction), mouse capture (on: repeated 
20 scanning/off: only one scanning), dimension of area of 

interest (scan size X, scan size Y) , magnification of the 
image in the area of interest, and on/off of the "synchronous 
link" are set. The center point of the area of interest is 
designated by placing a mouse cursor in the desired position 
2 5 on the screen shown in Fig. 1 and clicking the cursor. 

By turning on the "synchronous link", the 
synchronous link processing is performed, the position and 
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dimension of the area of interest designated with respect to 
the original image are also effective with respect to the 
comparative image, and the same area of interest is set with 
respect to two display images . The area of interest is 
5 synchronized and scanned in the same direction. In this 

manner, the past and present images of the same patient are 
arranged, compared with each other and observed, which is 
convenient for observation. This scanning processing is 
effective in examining symmetry of a human body. As the scan 

10 direction "horizontal" can be set, so that sideways display 

q of the image is handled. 

Q Moreover, in the image quality combo box 552 of the 

[*z scanning dialog box of Fig. 27, "image quality", n image 

If* quality application", "automatic recognition application" are 

T5 set. These are the same as those of the image quality combo 

f[ box 542 of the masking processing screen of Fig. 23, and 

f*] redundant description is omitted. 

y Fig. 29 is a flowchart of the scanning processing. 

Here, first the original image, and various 

20 parameters and flags for the scanning processing are inputted, 
and the comparative image is also inputted as occasion 
demands (step jl). Among these, the original image and 
comparative image are inputted beforehand in the step gl of 
Fig. 17, and other parameters and flags are inputted on the 

25 scanning dialog box of Fig. 27. 

It is judged in the next step 12 whether an 
automatic part recognition processing application flag is 
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on/off. When the automatic part recognition processing 
application flag is on, the automatic part recognition 
processing is executed in step 13. 

Moreover, it is judged in step 14 whether the image 
5 quality adjustment processing application flag is on/off, and 
when the flag is on, the processing advances to step 15 to 
execute the image quality adjustment processing. 

Furthermore, the enlargement/reduction processing of 
the area of interest is performed in step 16, further it is 
10 judged in step 17 whether the synchronous link processing 
© application flag is on/off, and when the flag is on, in step 
%l 18, the comparative image is also subjected to the processing 
,p of steps 12 to 16. 

'[ft In step 19, the image subjected to the scanning 

X5 processing in this manner is displayed. 

f'[ It is judged in step 110 whether or not the 

instruction for ending the scanning processing by the user is 

fcf given, and with the end instruction, this scanning processing 
ends, the scanning screen is closed and the usual display 

20 image is returned. 

It is judged in step ill whether or not one scanning 
of the area of interest ends. When the scanning has not 
ended yet, the processing returns to the step 12 to repeat 
the similar processing on the area of interest which has 

25 slightly moved from the position of the previous area of 
interest . 

When it is judged in the step ill that one scanning 
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ends, the processing advances to step 112 to Judge whether a 
mouse capture processing application flag is on/off. When no 
mouse capture processing is applied, the scanning processing 
is ended. When the mouse capture processing is applied, the 
5 processing returns to the step 12, and the similar processing 
is repeated with respect to the area of interest which has 
returned to a head position. 

Additionally, by operating a mouse during execution 
of the scanning processing the area of interest stops, and by 

10 operating the mouse again the scanning of the area of 

13 interest is continued. 

\i Fig. 30 is a flowchart of the automatic part 

V recognition processing. The automatic part recognition 

% processing is executed by the step h4 of the masking 

T5 processing (Fig. 26), or the step 13 of the scanning 

ft processing (Fig. 29). Additionally, step jl of the automatic 

part recognition processing is executed only for the first 
P time, and only step j2 is executed for the second and 

subsequent times with respect to the same image. 
20 In the step jl, map data indicating respective part 

positions in one piece of medical image is prepare, and in 

the step j2, the part appearing in the area of interest is 

recognized based on the prepared map data. 

Figs. 31 to 42 are explanatory views of a map data 
25 preparation processing procedure in the step jl of Fig. 30. 

Here, the recognition processing of the respective parts in 

the chest front simple radiophotography image will be 



described. 

(1) The pixel of the original image is curtailed t 
1/8 to form a reduced image (Fig. 31). 

(2) By subjecting the luminance to a threshold 
value processing "external part" is obtained (Fig. 32). 

(3) By positional information that the part is 
adjacent to the "external part" 601 and the threshold value 
processing "subcutaneous part" 602 is obtained (Fig. 33). 

(4) From information that the "external" and 
"subcutaneous" parts are rapidly cut off on the luminance 
value "shield plate" 603 is obtained (Fig. 34). 

(5) Based on the positional information on the 
image and threshold value processing "right lung" 604 is 
obtained (Fig. 35) . 

(6) Based on the positional information on the 
image and threshold value processing "left lung" 605 is 
obtained (Fig. 36). 

(7) From the positional information on the image 
and dimensional information that the part is held between t 
left and right lungs "heart" 606 is obtained (Fig. 37). 

(8) Based on the positional information on the 
image "diaphragm" 607 is obtained (Fig. 38). 

(9) Based on the positional information on the 
image "spinal cord" 608 is obtained (Fig. 39). 

(10) Based on the positional information on the 
image "mediastinum" (except the spinal cord and heart) 609 
obtained (Fig. 40). 
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(11) Based on the positional information on the 
image "abdomen" 610 is obtained (Fig. 41). 

(12) Based on the positional information on the 
image "right shoulder", "right armpit", "left shoulder", 

5 "left armpit" (area 611) is obtained (Fig. 42). Fig. 42 

integrally shows the area 611, but a lower 1/3 part of the 
area shows the armpit and an upper 2/3 part shows the 
shoulder, and the respective areas of "right shoulder", 
"right armpit", "left shoulder", "left armpit" are 
10 geometrically divided. 

O In step jl of Fig. 30, by these measures, the map 

%J data of the respective parts is obtained. 

J:- In step j2 of Fig. 30, the part corresponding to the 

Jil center coordinate point of the area of interest is recognized. 

15 In the present embodiment, the image which is easily 

L observed by the user is displayed as described above. 

Additionally, in the aforementioned embodiment, 

% mainly the examples of the medical image on the radiograph 

have been described, but the present invention is not limited 

20 to the radiograph, and the present invention can be applied, 
for example, to the medical image by an ultrasonic diagnosis 
device, a medical image by a stomach camera, a medical image 
by MRI, and various other medical images. 

As described above, according to the present 

25 invention, the appropriate image processing is always 

performed irrespective of the medical image type and the 
image high in diagnosis ability can constantly be provided. 
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WHAT IS CLAIMED IS: 

1. An image processing apparatus for subjecting a 
radiation image to an image processing, comprising: 

5 an image processing condition storing section for 

storing an image processing condition when the radiation- 
image is subjected to the image processing in accordance with 
a photography device type and a photography part when the 
radiation image is obtained; 
pUP a data obtaining section for obtaining the radiation 

image, and the photography device type and the photography 
\I part when the radiation image is obtained; and 
III an image processing section for reading the image 

HJ processing condition for the same photography device type and 
fc5 photography part as the photography device type and 

photography part obtained by said data obtaining section from 
p said image processing condition storing section, and 
subjecting the radiation image obtained by said data 
obtaining section to the image processing in accordance with 
20 the read image processing condition. 

2. An image processing apparatus for subjecting a 
medical image to an image processing, comprising: 

an image processing condition storing section for 
25 storing an image processing condition when the medical image 
is subjected to the image processing in accordance with a 
photography device type and a photography condition when the 
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medical image is obtained; 

a data obtaining section for obtaining the medical 
image, and the photography device type and the photography 
condition when the medical image is obtained; and 
5 an image processing section for reading the image 

processing condition for the same photography device type and 
photography condition as the photography device type and 
photography condition obtained by said data obtaining section 
from said image processing condition storing section, and 
JUO subjecting the medical image obtained by said data obtaining 
]ri section to the image processing in accordance with the read 
"!l image processing condition. 

~ss ; 
14;? 

Ill 3, The image processing apparatus according to 

tf5 claim 2 wherein said image processing section subjects the 
M medical image obtained by said data processing section to at 
O least a gradation conversion processing and a frequency 

emphasis processing, and 

said image processing condition storing section 
20 stores a frequency emphasis function indicating a degree of 
frequency emphasis in which a gradation conversion function 
and an average density around respective points of the 
medical image are used as variables in accordance with the 
photography device type and the photography condition. 

25 

4. The image processing apparatus according to 
claim 3 wherein before the gradation conversion processing, 
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said image processing section subjects the medical image 
obtained by said data obtaining section to a luminance 
correction processing using a dynamic range compression 
function in which the average density around the respective 
5 points of the medical image is used as the variable. 

5. The image processing apparatus according to 
claim 2, further comprising an image processing condition 
operating section for adding, changing, and deleting said 

M> image processing condition in response to an operation. 

6. The image processing apparatus according to 
111 claim 2, further comprising an image display section for 
<V displaying the medical image subjected to the image 

&5 processing by said image processing section. 

p 7 . The image processing apparatus according to 

claim 6 , further comprising an interested area designating 
section for designating a desired area of interest on the 

20 medical image displayed in said image display section in 
response to the operation, 

wherein said image display section lowers a 
luminance of an area excluding the area of interest 
designated by said interested area designating section to 

25 display the medical image. 



8. The image processing apparatus according to 
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claim 7 wherein said interested area designating section 
designates the desired area of interest on the medical image 
displayed in said image display section and designates a 
coefficient indicating a degree of drop of the luminance of 
5 the area excluding the area of interest in response to the 
operation, and 

said image display section lowers the luminance of 
the area excluding the area of interest designated by said 
interested area designating section down to the luminance in 
accordance with the coefficient designated by said interested 
L*| area designating section to display the medical image. 

-I* 9. The image processing apparatus according to 

W claim 7 , further comprising a part recognizing section for 

fc j 5 recognizing positions of a plurality of parts appearing in 
M one medical image, 

Q wherein said image processing section subjects the 

area of interest designated by said interested area 
designating section to the image processing in accordance 

20 with the part appearing in the area of interest among the 
parts recognized by said part recognizing section. 

10. The image processing apparatus according to 
claim 7 wherein said image display section arranges and 
25 displays a plurality of medical images, and 

said image display section applies the same area of 
interest as the area of interest designated by said 
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interested area designating section with respect to one 
medical image among the plurality of medical images displayed 
in the image display section to the plurality of medical 
images , and lowers the luminance of the area excluding the 
5 area of interest of each medical image to display the 
plurality of medical images. 

11. The image processing apparatus according to 
claim 6, further comprising a scanning processing designating 

,1,0 section for designating a scanning processing of setting the 

H H area of interest on the medical image displayed in said image 

display section and moving the area of interest in a 

f g predetermined direction in response to the operation, 
m wherein said image display section displays the 

WS medical image in which the area of interest successively 

H moves, and the luminance of the area excluding the area of 

Q interest is lowered in response to designation of the 

O 

scanning processing by said scanning processing designating 
section. 

20 

12. The image processing apparatus according to 
claim 11, further comprising a part recognizing section for 
recognizing positions of a plurality of parts appearing in 
one medical image, 

25 wherein said image processing section subjects the 

successively moving area of interest to the image processing 
in accordance with the part appearing in the successively 
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moving area of interest among the parts recognized by said 
part recognizing section. 

13. The image processing apparatus according to 
5 claim 10 wherein said image display section sets the same 

area of interest in the same position at the same timing- and 
arranges and displays a plurality of images in which the area 
of interest synchronously moves at the same speed in response 
to the designation of the scanning processing by said 
l||0 scanning processing designating section. 

14. The image processing apparatus according to 
% claim 2 wherein said data obtaining section obtains a 

SSJ5S S 

Hl radiation image as said medical image. 

H 15. An image processing method for subjecting a 

CI medical image to an image processing, comprising steps of: 

storing an image processing condition for subjecting 
the medical image to the image processing in accordance with 
20 a photography device type and a photography condition when 
the medical image is obtained; and 

obtaining the medical image, and the photography 
device type and the photography condition when the medical 
image is obtained, and subjecting the obtained medical image 
25 to the image processing in accordance with the image 

processing condition for the same photography device type and 
photography condition as the obtained photography device type 



and photography condition. 

16. An image processing program storage medium in 
which a program for operating a computer system as an image 
processing apparatus for subjecting a medical image to an 
image processing is stored, 

wherein said image processing program comprises: 

a data obtaining section for obtaining the medical 
image, and a photography device type and a photography 
condition when the medical image is obtained; and 

an image processing section for subjecting the 
medical image obtained by said data obtaining section to the 
image processing in accordance with an image processing 
condition for the same photography device type and 
photography condition as the photography device type and 
photography condition obtained by the data obtaining section. 
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ABSTRACT OF THE DISCLOSURE 

There is disclosed an image processing apparatus for 
performing an image processing on a medical image represented 
5 by digital data in a medical field, and the appropriate image 
processing is performed with respect to various medical - 
images. An image processing condition suitable for a 
photography condition is stored beforehand in an image 
processing condition storing section 218, and an image 

r i0 processing section 212 subjects the medical image to an image 
processing based on the image processing condition suitable 

l !l for the photography condition when the medical image is 

-;f obtained. 
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START 



PREPARE MAP DATA OF EACH PART 



j1 



OBTAIN CORRESPONDING PART 
FROM IMAGE COORDINATE VALUE 
OBTAINED CHEST FRONT PARTS 
ARE EXTERNAL PART, RIGHT LUNG, LEFT LUNG, 
SUBCUTANEOUS PART, HEART, SPINAL CORD, 
DIAPHRAGM, RIGHT ARMPIT.RIGHT SHOULDER, 
LEFT SHOULDER, SHIELD PLATE 



J'2 



END 



Fig. 30 
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Japanese Language Declaration 








As a below rvarr.-d inventor, t neraby decfa; 'bat: 




My residence, post office address and citizenship are as stated 
next to my name 




1 believe f arn the original, first and sole inventor (if only one name 
is Hated below) or an original, first and joint Inventor Qf plural 
names are listed below) of the subject matter which is claimed and 
for which a patent Is sought on the invention entitled 


|1| 


IMAGE PROCESSING APPARATUS , IMAGE 
PROCESSING METHOD, AND IMAGE PROCESSING 
PROGRAM STORAGE MEDIUM 




the specification of which is attached hereto unless the following 
box Is checked: 


« 1 } _ / 4 — l- ■ rw J i J 4 w • ^p* | * t W9< " iM w I m ar / 

MR MM*** £ L. 


| j was filed on 

ss United States Appifestfon Number or 
PCX International Application Number 

and was amended on 
ffiaDoftcafafe). 




1 hereby state that 1 have reviewed and understand the contents of 
the above identified ipedhcation, including the claims, as 
amended by any amendment referred to above. 


fill, at««»Ji£#tJ»3 7ltf»l*5fi*»c«|»$>vSa: 


1 acknowledge the duty to disclose information which is material to 
patentability as defined in T We 37, Code of Federal Regulations, 
Section 1-S4\ 
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Burden Hour Statement: This form is estimated to take 0,4 hour* to ample**. Time wUJ vary depending; ujxwi Ow needs of the individual «ae. Any comment* on the 
«mtHify of time ytni are required to complete thi* ti»rm sWd He sent to the Chief Information Officer, P»l«* and TnuUmark Office. Waahitujtort, DC 20231 . DO NOT 
SEND FEES OR COMPLETED FORMS TO THIS ADDRESS. SEND TO: Commissioner of Patent* and Trademarks. Washington, DC 20231 . 
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SU±. 3 5MH9^(a)-(d) #3*1* 3 6 5 * 

#LTi**fmtifiWfc*lJ 3 6 5 (a)#Kas-r<W*Sffi«*, X 



Prior Foreign Applicationfs) 

Hei. 11-329571 
(Number) 
(#*» 

2000-325269 

(Number) 
(**) 



Japan 



(Country) 



Japan 



,<W£) 



(Country) 



(Application No.) 



(Filing Date) 



(Application No.) 
(HUB**) 



(Application No.) 



(Filing Date) 
(W*R) 

(Filing Date) 



I hereby claim foreign priority under Title $S t United States Code, 
Section 11 J (aM<*) or 3«5(b) of any foreign appiicattonfs) for patent 
or inventor** certificate, or 3€£(a) of any PCT International 
application which designated at least one country other than the 
United States, fisted below and have alto identified below, by 
checking the box, any foreign application for patent or inventor's 
certificate, or PCT International application having a filing date 
before that of the application on which priority is claimed. 

Priority Not Claimed 

19/November/1999 

(Day/Month/Year Filed) ° 

(mm*% B) 

25/Qctober/2Q00 



(Day/Month/Year Filed) 

CfflaWflH) ° 

I hereby claim the benefit under Title 35, United States Code, 
Section 11S{e} of any United States provisional applications) listed 
below. 



(Application No.) 
(WJ6«^) 



(Filing Date) 
WMB) 



I hereby claim the benefit under Title 3f , United States Code, 
Section 120 of any United States application^), or 3«S(c) of any 
PCT International application designating the United States, listed 
below and, insofar as the subject matter of each of the claims of 
this application is not disclosed in the prior United States or PCT 
International application in the manner provided by the first 
paragraph of Title 36, United States Code Section 112, I 
acknowledge the duty to disclose information which is material to 
patentability as defined in Title 37. Code of Federal Regulations, 
Section 1.54 which became available between the filing date of the 
prior application and the national or PCT international flSng date of 
application. 

(Status: Patented, Pending, Abandoned) 
WU s MW^TO. **«*) 

(Status: Patented, Pending, Abandoned) 

I hereby declare that all statements made herein of my own 
knowledge are true and that al statements made on information 
and belief are believed to be true; end further that these 
statements were made with the knowledge that willful false 
statements and the Xke so made arc punishable by fine or 
irnprisorment, or both, under Section 1001 of TWe 11 of the 
United States Code and that such willful falsa statements may 
Jeopardize the validity of the application or any patent issued 
thereon. 
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Approved for vmm through 8/30/06. OM 8 COS 1-0032 
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Undef th« Pap#fwwt< Reduction Act of 1005, m p«uni »r» inquired to mepond to a coeection of Information unteea tt displaye a vtfid OMB control nomt^r. t 



Japanese Language Declaration 



POWER Of ATTORNEY: Am a narmd inventor, I hereby appoint 
the following attomey(*) anoVoc **ent<«} to prosecirt« this 
application and transact aff bu«ne» in the Patent and Traderrwlc 
Office connected th«r«wrtft (list /T*m« **cf r+gt*tr*doft number) 

Pitcher, 25,908; John C. Garvey, 28.607; J. Randall Beckers. 



James D Halsey. Jr., 22,729; Harry John Staas, 22,010; David M. 

30.358. William F Herbert. 31.024; Richard A. Gollhofer, 31.106; Mark J. Henry. 36,162; Gene M. Gamer 11, 34,172; Michael D. 

Stem, 37.240; Paui I. Kcsvetz, 35,230; Gerald P. Joyce. HI. 37,648; Todd E. Marlette. 35.269; Hartan B. Williams. Jr.. 34.756; 
George N Stevens, 36.938. Michael C. Sold ner, 4 1,455; Norman L. Ourada. 41,235; Kevin R. Spivalt. P-43.I48; and William M. 
Schertter. 35 .348 (agent) 

li# ^gi&tt' t*c S«nd Correapondenc* to: 

STAAS & HALSEY 
700 Eleventh Street, N.W. 
Suite 500 

Washington, D C. 20001 







Direct Telephone Catte to; </7#/r># end /•/epnene number) 






STAAS & HALSEY 
(202) 434-1500 


■ ■ ~; 










Fu* name of sole or first inventor 

Takatoshi Yamanaka 








Inventor' » aignature Date 

"uW"te^ Y<Mr^*\a^H November 8, 20 


DO 


'Ik: 

fli 




Residence 

Kawasaki , J apan 








Cltteenshlp 

Japanese 








Post Office Address c/o FUJITSU LIMITED, 

1-l.Kamikodanaka 4 -chome , Nakahara-ku, 




'-■iK 


Kawasaki, Kanagawa 211-8588 Japan 








Ful name of second joint inventor, if any 

Kohei Murao 








Second iov«crtor*» signature Det« 


) 




£/# 


Residence 

Kawasaki, Japan 






PS IS 


Citizenship 

Japanese 








Post Office Address c /o FUJITSU LIMITED, 

1 - 1 , Kamikodanaka 4 -chome , Nakaharv*-fci i . 






Kawasaki, Kanagawa 211-8588 Japan 








(Supply tkrWUr information and signature for third and subsequent 
joint inventor*.) 
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